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1 Introduction 


Krohn-Rhodes theorem asserts that every deterministic automaton can be de¬ 
composed into cascades of irreducible automata. Algebraically, this implies that 
a finite semigroup acting on a finite set factors into a finite wreath product of 
finite simple groups and a semigroup of order 3 consisting of the identity map 
and constant maps on a set of order 2. The semigroups in this factorization are 
prime under the semidirect product. 

In Section 2, we formulate a definition of probabilistic automata in which a 
statement analogous to the prime decomposition follows directly from Krohn- 
Rhodes theorem. 

Section 3 deals with Green-Rees theory. We determine Green’s relations on 
the monoid of stochastic matrices in order to characterize the local structure of 
probabilistic automata. 

Krohn-Rhodes theory is introduced in Section 4. The prime decomposition is 
presented as a framework to study the global structure of probabilistic automata. 

Section 5 discusses Munn-Ponizovskii theory. We prove that irreducible 
representations of a probabilistic automaton are determined by those of finite 
groups in its holonomy decomposition, which is a variant of the prime decom¬ 
position. 


2 Automata and Semigroups 

2.1 Deterministic Automata 

Given a set A', Fx denotes the monoid of all maps A —> A. If A is of order n, 
we can index X by 

n = {i | 0 < i < n} 

with a bijection X —> n, and write F n = Fx- 

Definition 2.1. A deterministic automaton is a triple (A, E,d) consisting of 
finite sets X and E along with a map 5 : X X E —> A. We call X a state set, E 
an alphabet, and S a transition function. 

Let E* be the free monoid on E. We can define a right action of E* on A 
by xa = S(x,a), where x £ X and a £ A. This action may not be faithful, and 
hence we consider the canonical homomorphism a : E* —> Fx- If E + is the free 
semigroup on A, then 

S = E + cr 

acts faithfully on A. Since Fx is finite, so is S. 

Definition 2.2. A transformation semigroup is a pair (A, S) in which a finite 
semigroup S acts faithfully on X from the right. 

In case S' is a monoid such that Is = lx, we refer to (A, S) as a transfor¬ 
mation monoid. If, in addition, S is a group, (A, S) is called a transformation 
group. 


2 


If S is not a monoid, we can adjoin an identity element 1 in a natural way to 
form a monoid S 1 . It is understood that S 1 = S when S' is a monoid. Similarly, 
in its absence, adjuction of a zero element 0 defines a new semigroup S°. We 
write FSgp for the category of finite semigroups. 

2.2 Probabilistic Automata 

Let X by a finite set. Then PX is the set of all probability distributions on X. 
An element p £ PX is written as a formal sum 

M = E K x ) x - 

x£X 

We can regard PX as a subset of the free R-module on X, although PX itself 
does not have an additive structure. 

Definition 2.3. A probabilistic automaton is a quadruple (X, E, 6, P) consisting 
of finite sets X and E along with a map 5 : X x E —>• X and its extension 
P(5 : PX x PE —> PX defined by 

P(5(tt,/z) = E tt( x)p(a)S(x, a) 

(x,a)(zX X E 

for 7r £ PX and p £ PE. 

For a subset Cl of PE, the quintuple (X, E, 5 , P, Cl) is an instance of (X, E, S , P), 
in which case P<J is restricted to PX x Cl', where CY denotes the closure of the 
set generated by Cl. When Cl is finite, (X, E, 6, P, f2) resembles the classical 
definition of a probabilistic automaton [16]. 

Again, set S = E + tr, where cr : E* —> Fx is the canonical homomorphism. 
Given p £ PA, we abuse notation by writing p for its corresponding distribution 
in P5 1 , so that for any s £ S, 

A»(s) = ^( a )' 

aa=s 

Then PS 1 is closed under convolution, which is given by 

(p*v)(s) = 

s=tu 

for p, v £ P5 1 , and hence P5 forms a semigroup under convolution. Since S is 
finite, as a topological semigroup, PS is compact Hausdorff. 

Definition 2.4. A transition semigroup is a triple (X, S, P) in which S is a 
finite semigroup acting faithfully on a finite set X from the right, inducing a 
right action of PS on PA' defined by 

E 7 r ( a; )i i ( s )y 

xs=y 

for 7r £ PX and p £ PS. 
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For Q C PS, the quadruple (.X , S, P, Q ) is an instance of (X, S, P), in which 
case the action of PS on PX is restricted to Q', where Q' denotes the closure of 
the set generated by Q. 

It is easy to see that w/j, € PX. Although we require that S acts faithfully 
on X, the same is not true of the action of PS on PX'. We refer to (X, S, P) as 
a transition monoid if (X', S) is a transformation monoid. A transition group is 
defined accordingly. 

3 Local Structure of Probabilistic Automata 

3.1 Green-Rees Theory 

We introduce the work of Green and Rees as presented by Clifford & Preston 

[2] and Rhodes & Steinberg [18]. 

A subset I ^ 0 of a semigroup S is a left ideal if SI C I. A right ideal is 
defined dually. We say I is an ideal if it is both a left and right ideal. Moreover, 
S is left simple, right simple, or simple if it does not contain a proper left ideal, 
right ideal, or ideal. For any s G S, we refer to L(s) = S 1 s, R(s) = sS 1 , and 
J(s) = S 1 sS 1 , respectively, as the principal left ideal, principal right ideal, and 
principal ideal generated by s. 

Definition 3.1. Let S be a semigroup. Then the quasiorders on S given by 

(1) s <it if and only if L(s) C L(t), 

(2) s < t t if and only if R(s) C R(t), 

(3) s <i t if and only if J(s ) C J(t), 

(4) s <[, t if and only if s <{t and s <„ t 

induce equivalence relations ~f,, and ~j, respectively, on S. Further¬ 

more, the relation 

0 = 1 o t = r o [ 

in S x S defines an equivalence relation on S. These five equivalence relations 
on S are known as Green’s relations. 

Green’s relations coincide in a commutative semigroup, while each relation 
is trivial for a group. In S x S, 

f) = lntciutci>cj. 

Moreover, is a right congruence and ~ t is a left congruence. We write the 
l-class of s € S as 

L s = {t G S | s t}, 

and define R s , J s , H s , and D s analogously. 

Proposition 3.2. If e is an idempotent in a semigroup S, then (1) SeC\J e = L e , 
(2) eS n J e = R e , and (3) eSe (~l J e = H e . 

For any u £ S, the left translation by u is the map A u : S ^ S defined by 
s\ u = us. Its dual, denoted p u , is the right translation by u. Green [6] used 
translations to construct bijections L s —> Lt and R s Rt when s t. 
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Lemma 3.3 (Green). Suppose s,t £ S, where S is a semigroup. 

(1) If us = t and vt = s for u,v £ S 1 , so that s ~[ t, then the maps A„|i{ s 

and are inverses of one another. 

(2) If su = t and tv = s for u, v £ S 1 , so that s ~ r t, then the maps P u \l s 
and p v \L t are inverses of one another. 

Koch & Wallace [ 8 ] formulated a sufficient condition for 5- and j-relations to 
agree with one another. A semigroup S is said to be stable if 

( 1 ) s ts if and only if s ts, 

( 2 ) s st if and only if s ~j st 

for any s,t £ S. This ensures that D s = J s for every s £ S. In particular, 
finite semigroups, commutative semigroups, and compact semigroups are stable. 
For stable semigroups, Lemma 3.3 implies that [-classes contained in the same 
j-class have identical cardinality. The same is true of r- and [(-classes. 

We say s £ S is regular , in the sense of von Neumann, if there exists t £ S 

such that sts = s. If, in addition, tst = t, t is an inverse of s. A regular element 

always has an inverse, and so s is regular if and only if s has an inverse. We 
call S a regular semigroup if each of its elements are regular. If every element 
has a unique inverse, then S is an inverse semigroup. 

Definition 3.4. Given sets A and T, a A x T Rees matrix over a group G is a 
map ( u\ p ) : A x T —>• G. A Rees semigroup of matrix type is a set 

9Jl(G, T, A, ( u\ p )) = {(p, g, A) | g £ G, p £ T, A £ A} 

endowed with a product defined by the rule 

(P, 9 , A)( 7 , h, a) = (p, gu X yh, a). 

We call G the structure group o/9JT(G, T, A, ( u\ p )). 

It is easy to see that 3Jt(G, T, A, (u\ p )) is indeed a semigroup. By convention, 
we write 

an°(G, r, a, (« Ap )) = an(G°, r, a, ( UXp )). 

Moreover, ( u\ p ) is called regular if every row and column has a nonzero entry, 
which is the same as saying 9JI°(G, T, A, (u\ p )) is regular as a semigroup. 

Suppose 0 £ S and S 2 ^ 0. Then S said to be 0-simple if it does not contain 
a nonzero proper ideal. It is easy to see that if 0 ^ S', then S is simple if and only 
if S° is 0-simple. Under the stability assumption, Rees [17] classified 0-simple 
semigroups in terms of Rees matrices. 

Theorem 3.5 (Rees). A stable semigroup S is 0-simple if and only if 

s^m°(G, r,A,(u Xp )) 

such that G is a group and ( u \ p ) is regular. 
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Assume S is stable. If s £ S is regular, then every element of J s is regular. 
Moreover, there exists an idempotent e £ J s such that H e is a maximal subgroup 
of S with e as identity, and H e = Hf for any idempotent f £ J s . 

For every s £ S, set I(s) = J(s) — J s . Then I(s) is an ideal of J(s) unless 
it is empty. The principal factor of S at s is the semigroup 




J(s)/I(s) if J s is not the minimal ideal, 
J s U 0 otherwise. 


Alternatively, we can think of as the set J s U 0 endowed with a product given 
by the rule 


tu = 


tu 

0 


if tu £ J s , 
otherwise. 


If S is stable, J s is regular if and only if is 0-simple, in which case, by Theorem 
3.5, there is an isomorphism — > Wl°(G, T, A, (u\ p )). If J s is nonregular, then 
Jg is a null semigroup in which tu = 0 for all t,u £ J s . 


3.2 Local Structure of Transition Semigroups 

Any matrix over R is said to be stochastic if all entries are nonnegative and each 
row sums to unity. We write S(n, R) for the monoid ofrtxn stochastic matrices 
over R. A stochastic matrix is bistochastic if each column sums to unity. The 
submonoid of bistochastic matrices in S(n,R) is denoted B(n,R). We can also 
define a stochastic matrix over any proper unitary subring of R. In particular, 
S (n, Z) is the monoid of maps n —> n and B(n, Z) is the group of permutations 
on n. 

We associate with each s £ S a matrix (s xy ) : X x X —>• [0,1] with (x, y) i—X 
51j. s , where is the Kronecker delta on X x X. Clearly, (s xy ) is row monomial, 

and hence _ 

i»x y ) = J2h(s) ■ ( s xy ) 

ses 

is stochastic for any p £ PS 1 . It is readily verified that 

((p, * v)xy) = ( Hxy)(yxy )■ 

For any finite semigroup S, PS 1 is isomorphic to a subsemigroup of P F n = 
S(n,R), and so we first study Green’s relations on S(n,R). Schwarz [22] showed 
that every maximal subgroup is isomorphic to a symmtric group Sk for some 
1 < k < n. Wall [23] characterized 1- and r-relations for regular elements of 
S(n,R). Green’s relations on B(n,R) were resolved by Montague & Plemmons 
[ 12 ]- 

Let ( Sij ) £ S(n,R). In block matrix form, 0 and 1, respectively, stand for 
the zero and identity matrices of suitable size. There exists (pij) £ B(n, Z) such 
that 

C Pij)(sij ) = , 
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where rows of s q are linearly independent vectors that generate the same convex 
cone as rows of (sy). A row echelon form of (s.y) is any matrix of the form 

(u o) 

where u is stochastic. We call s g a reduced row echelon form of (sy), which is 
unique up to row permutation. A pair of elements of S(n,R) is row equivalent 
if they have identical reduced row echelon form up to row permuation. 

If (sy) has a pair of nonzero columns in the same direction, then they appear 
as the first two columns of (sy )(py) for some (pij) £ B(?r, Z). Their sum, whose 
direction remains unchanged, is the first column of 

(sij)(Pij) (o , 

where the leftmost entries of e £ B(2,Z) are unity. We can repeat this process 
of adding up columns in the same direction until the matrix is in column echelon 
form 

(so si) , 

where nonzero columns are pairwise in different directions and columns of so, 
which are linearly independent, generate the same convex cone as columns of 
(sy). The reduced column echelon form of (sy), which is unique up to column 
permutation, is obtained by removing any zero columns from ai. When a pair 
of elements of S(n, R) have identical reduced column echelon form up to column 
permutation, we say that they are column equivalent. 

The echelon form of (Sy) is the row echelon form of the column echelon form 
of (sy). This is the same as the column echelon form of the row echelon form 
of (sy) as matrix multiplication is associative. If the reduced echelon form is 
defined accordingly, then it is unique up to row and column permutations. A 
pair of elements of S(n,R) is called equivalent if they have identical reduced 
echelon form up to row and column permutations. 

Proposition 3.6. If (sy), (fy) £ S(n,R), then 

( 1 ) (Sy) ~i ( t'ij ) if and only if (Sy) and (tij) are row equivalent, 

(2) (Sy) (tij) if and only if (Sij) and (fy) are column equivalent, 

(3) (Sy) ~j (tij) if and only if (Sy) and (fy) are equivalent, 

(4) (sy) ~f, (tij) if and only if (s^) and (Uj) are row and column equivalent. 

Proof. (1) Suppose (Sy) ~i (fy). Then the rows of (Sy) and (fy) generate the 
same convex cone, and so they must be row equivalent. 

Conversely, if (sy) and (fy) are row equivalent, then there exists (pij), (qij) £ 
B(?r, Z) such that 


( Pij){sij ) 



and (qij)(Uj) 
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are in row echelon form with rsg = tg for some permutation r. Moreover, every 
row of t\ is contained in the convex hull generated by the rows of Sg, so that we 
can find u that is stochastic and satisfies usg = t\ . Similarly, vsg = i where v 
is stochastic. Therefore 

( r 0\ /r* 0\ 

u g J ( Vij)( s ij) = (Uj) a n d ( Pij ) ( q J ( Qij)(Uj ) = ( s ij)> 

and so we are done. 

(2) If the first two columns of () are in the same direction, then for 
any u £ S(2,R) of rank one, we can always find v £ S(2,R) of rank one such 
that 

(Sij)(pij) ^ j) = (Sij)(Pij)- 

This shows that (sjj) and its column echelon form are t-related. 

Let () ~ t (Uj)- We can assume (sij) and (Uj) are in column echelon form. 
Then there exist (i%), (iHj) G S(n,R) such that 



We can now write 

so = to^oo + t±Uig. 

Columns of sg generate the same convex cone as those of tg, and hence so = 
tgdp, where d is diagonal and p a permutation. Furthermore, columns of t\ are 
properly contained in the convex cone generated by those of tg, so that t\ = tgw 
for some w that has at least two positive entries in every column. This implies 
that it 10 = 0, whence tg{dp—ugg) = 0. As columns of tg are linearly independent, 
it follows that ugg = dp. By a similar reasoning for 


tg — SgVgg + SiVig, 

we can deduce that ^oo = p t d~ 1 and t>io = 0. This shows d = 1, or else (w ,; 7 ) or 
{Vij ) fails to be stochastic. It is immediate that itoi = vgi = 0, and so si = t\Un 
and t\ = si'Cn. If nonzero columns of Si and t\ are linearly independent, we 
are done. Otherwise, we can repeat this argument for Si and t\. This process 
ends in finite steps, and thus the result follows. 

(3) By stability, (sy) ~j ( Uj ) if and only if there exists («y) £ S(ra,R) such 
that (s^) ~[ {uij) and {uij) {Uj), which is the same as saying the reduced 
column echelon form of the reduced row echelon form of (,s.y) is identical to the 
reduced column echelon form of the reduced row echelon form of {Uj ) up to row 
and column permutations. 

(4) This is a direct consequence of (1) and (2). □ 

Every compact semigroup contains an idempotent, so that J M is regular for 
some p £ PS. Doob [3] identified all idempotent elements in S(n, R). 
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Theorem 3.7 (Doob). If (e^) £ S(n, R) is of rank k with 1 < k < n, then (eij) 
is idempotent if and only if there exists (pij) £ B(?r, If) such that 

( Pij ) i e ij ) ( Pij ) = 

where s is stochastic and e is of the form 



V e fe / 


such that e; is rank one and stochastic for 1 < i < k. 

We can count the number of distinct regular j-classes in S(n,R) once it is 
known which idempotent elements belong to the same j-class. 

Corollary 3.8. If (eij) and (fij) are idempotent in S(n, R), then () ~j (fij) 
if and only if rank(e, :) ) = rank (fij). 

Proof. Suppose (e^) is of rank k. It follows from Theorem 3.7 that there ex¬ 
ists (p^) £ B(n,Z) such that the reduced echelon form of ( Pij)(eij)(PijY is an 
identity in S(fc, Z). This completes the proof. □ 

It is immediate from Corollary 3.8 that there are n regular j-classes in S (n, R). 
In general, we cannot say that if (e ij) ~j (fij) in S(n, R), then (e^) ~j (fij) in 
a proper subsemigroup of S(n, R). Consider, for example, the subsemigroup 

( fl 0 0\ /0 0 l\ /0 0 1\) 

0 0 1,0 1 0,0 0 1 ]\ 

[\0 0 1/ \0 0 1/ \0 0 1/ J 

of S(3,R). It is true, however, that if t and u are regular in a subsemigroup T 
of 5, then t ~i u in T if and only if t u in S. Analogous statements hold for 
r- and fi-relations. 

Theorem 3.9. Suppose (X, S, P) is a transition semigroup such that ip : P5 1 —>• 
T is an isomorphism, where n = |X| and T is a subsemigroup of S(n, R). For 
any idempotent e £ PS 1 , define A = {A £ T | A ep} and r = {p £ T \ p 
etp}. If G = H e then 

j° e ^m°(G,r,A,(u Xp )), 
where (u\ p ) : A x T —> G° is given by 

X p if A p £ G , 

0 otherwise. 

Here, ( p , < 7 , A) = 0 in 9H°(G, T, A, ( u\ p )) whenever g = 0. 

Proof. This follows directly from Theorem 3.5 and Proposition 3.6. □ 

Theorem 3.9 carries over to an instance (X, >S', P, Q) of ( X , S, P) since Q' is 
compact, and hence stable. 



e 0 
se 0 
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4 Global Structure of Probabilistic Automata 


4.1 Krohn-Rhodes Theory 

A pair of transformation semigroups (A, S) and (Y, T) are said to be isomorphic, 
written (A, S) = (Y. T), if there exists a biiective map p : Y —> X such that 

(1) psp- 1 e T for all s € S, 

(2) p _1 tp e S for all t G T. 

It is easy to see that this implies S is isomorphic to T. 

Definition 4.1. Let (X,S) and ( Y,T ) be transformation semigroups. If there 
exists a surjective partial map p : Y —»• X such that for every s £ S, ps = tip 
for some t GT, so that the diagram 


Y 

V 

X 


< Y 


X 




commutes, then (A, S) is said to divide (Y, T) by p. We write 

(A, S) -< (Y,T) 

to mean (A ,S) is a divisor of ( Y,T ), and refer to p as a covering. 


If T is not a monoid, a homomorphism p : T —> S has a natural extension 
p 1 : T 1 —> S 1 given by 


tp 1 


1 if f = 1 , 
tp otherwise. 


In case T is a monoid, set p 1 = p. We often identify S with the transformation 
semigroup (S 1 , S), and say that T covers S when there is a covering p 1 , so that 
T covers S as transformation semigroups. 

If £ € A, a; stands for the constant map A —> X onto x. The semigroup 
of all such maps is denoted A. The closure of (A, S) is the transformation 
semigroup 

JxTS) = (A, S U A). 


As the empty set is vacuously a semigroup, A can be identified with the transfor¬ 
mation semigroup (A, 0), in which case X = (A, A). In addition, we associate 
to (A, S) the transformation monoid 


(A, S ') 1 = (A, S' U lx), 


which means S l = (S' 1 , S' 1 ). 
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Definition 4.2. Let (A, S') and (Y. T) be transformation semigroups. Suppose 
that the action of t £ T on f £ S Y is given by y t f = ytf for any y £Y. Then 
the wreath product of ( X , S) by (Y, T) is the transformation semigroup 

(X, S) l (y, T) = (X x Y, S Y X T), 

where ( x,y)(f,t ) = (. x(yf),yt ) for any (x,y) £ X x Y and ( f,t ) G S 1 x T. 

Let TSgp denote the category in which objects are transformation semi¬ 
groups and morphisms are coverings of objects. Evidently, ( X , S) = (Y. T) if 
and only if (A, S) ~< (Y,T) and ( Y,T ) -< (A, S), whence -< is a partial order 
on TSgp. In Definition 4.2, it is routine to check that S' 1 x T is a semigroup 
acting faithfully on X x Y. It follows that isomorphism classes of TSgp form a 
monoid under the binary operation l with unity 1 1 . A decomposition of ( X , S) 
is an inequality in TSgp of the form 

(A, S) ~< (Xi,Si) 1---1 (X n , S n ) 

such that either Xi is strictly smaller than X or Si is strictly smaller than S for 
all 1 < i < n. 

Proposition 4.3. Let ( X , S) be a transformation semigroup. 

(1) If G is a maximal subgroup of S, then 

(A', S) ~< (A,S\< TflG. 

(2) If S = I U T, where I is a left ideal in S and T a subsemigroup of S, then 

(A, S) -< (A, I ) 1 ? (T U l x , T). 

Every finite group admits a composition series, which determines a unique 
collection of simple group divisors. Jordan-Holder decomposition accounts for 
all simple group divisors. 

Theorem 4.4 (Jordan-Holder). If G is a finite group, then 

G -< Gi l ■ • ■ l G n , 

where Gi is a simple group divisor of G for 1 < i < n. 

By Proposition 4.3, we can view Theorem 4.4 as a decomposition for trans¬ 
formation groups. Krohn-Rhodes decomposition generalizes Jordan-Holder de¬ 
composition to transformation semigroups. Krohn and Rhodes [10] first showed 
that a finite semigroup is either cyclic, left simple, or the union of a proper left 
ideal and a proper subsemigroup, and then argued inductively by showing that 
any transformation semigroup admits a decomposition in TSgp. 

Theorem 4.5 (Krohn-Rhodes). If(X,S) is a transformation semigroup, then 

(A, S) < {X 1 ,S 1 )l---l{X n ,S n ), 

where either (A i,Si) = 2 1 or (A i,Si) is a simple group divisor of S for 1 < i < 

n. 

In FSgp, we say S is prime if S -< T x U implies that either S -< T or S -<U. 
The prime semigroups are precisely the divisors of 2 1 and the finite simple 
groups. The decomposition of Theorem 4.5 is called the prime decomposition. 
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4.2 Global Structure of Transition Semigroups 

Let X and Y be finite sets. If ip : Y —> X is a partial map, we define its 
extension to be a partial map P ip : P Y PX given by 

{ EE 7 r (y)x if yip ^ 0 whenever n(y) > 0 , 

x£Xy<p=X 

0 otherwise 

for any 7 r £ P Y. 

Definition 4.6. Let (X, S, P) and (Y, T, P) be transition semigroups. If there 
exists a surjective partial map ip : Y —s- X with extension P ip : P Y —5- PX such 
that for every p £ PS, (P ip)p = v(Pp) for some v £ FT, so that the diagram 



commutes, then (X, S, P) is said to divide ( Y, T, P) by Pip. We write 

(X,S,P) -< (y,T,P) 

to mean (X, S', P) is a divisor of (Y, T, P), and refer to ip as a covering. 

Notation for transformation semigroups naturally carry over to transition 
semigroups. Therefore 

(X, S, P) = (X, S U X, P) and (X, S, P ) 1 = (X, S U l x , P). 

We also identify (X, P) with (X, 0, P) and (S, P) with (S^S, P). 

Lemma 4.7. If (X, S, P) and (Y, T, P) are transition semigroups, then (X, S, P) 
divides (Y, T, P) if and only if(X,S ) divides ( Y,T ). 

Proof. Suppose (X, S, P) divides (Y,T,P) by Pip. Fix s £ S. Then (P^p)s = 
vfPip) for some v £ PY. This means 

yips = v{t)ytip 

t£T 

for any y £ Y such that yip ^ 0. We conclude ips = tip for some t £ T with 
v(t) > 0. 

Conversely, assume (X, S) divides (Y, T) by ip. Given p £ PS, choose t £ T 
such that ips = tip for every s £ S with p(s) > 0. Let UcTbe the collection 
of all such selections. Define v £ PT by 

[ E ^ if 1 G U > 

v[t) = \ (ps=tip 

I 0 otherwise. 
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Then we can write 


ir{F<p)n=^2 7T (y')t J '( s ) x = Tt(y)v(t)x = iris (Ftp), 

xGX yips=x xEX ytip=x 


where 7 r g PY. □ 

To extend Definition 4.2 to transition semigroups, we take the wreath prod¬ 
uct of (X, S ) by (Y, T), and consider the right action of F(S Y xi T) on P(X x Y). 

Definition 4.8. Let (X,S,F) and (Y, T, P) be transition semigroups. The 
wreath product of (X, S, P) by (Y, T, P) is the transition semigroup 

(X,S,F)l(Y,T,F) = (Z,U,F), 

where (Z, U) = (X, S ) l (Y, T). 

It is clear that (Z, U, P) is well-defined since (X, S)l(Y, T ) is a transformation 
semigroup in its own right. 

Theorem 4.9. If (X, S, P) is a transition semigroup, then 
(X, 5 , P) -< (X 1; Si,P) 1---1 (X„, S n , P), 

where either (X,;, Sf) = 2 1 or (X,;, Sf) is a simple group divisor of S for 1 < i < 

n. 

Proof. This is an immediate consequence of Theorem 4.5 and Lemma 4.7. □ 

We define a transition semigroup (X, S, P) to be prime if (X, S) is prime as 
a transformation semigroup. Theorem 4.9 provides a way to classify any set of 
stochastic matrices. If T is any semigroup of S(n,R), then S = supp(T) is a 
set of row monomial binary matrices isomorphic to a subsemigroup of F n . Set 
n = X. Then each matrix in T is an instance in (X, S, P). 


5 Representation Theory of Probabilistic Autom¬ 
ata 

5.1 Munn-Ponizovskii Theory 

Let A be an associative algebra with unity. We denote by Mod-T the category 
of right A- modules. Put J = Rad(T). For any primitive idempotent e of A, eJ 
is the unique maximal submodule of eA in Mod-A. Assume further that A is 
noetherian or artinian. This ensures that there exists a collection of pairwise 
orthogonal central idempotents ei, ■ • • ,e n € A such that 1a = ei + ■•■-(- e n , or 
equivalently, 

Aa = ei-A © ■ • • © e n A. 
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Moreover, M £ Mod- A is simple if and only if M = eiA/eiJ for some 1 < i < n, 
and hence there is a one-to-one correspondence between isomorphism classes of 
irreducible modules and that of principal indecomposable modules. 

For any idempotent e of A , set B = eAe. Then B is a subalgebra of A. We 
define restriction as the covariant functor Res^ : Mod- A — >• Mod-S given by 

Res i(M) = Me 

and induction as its left adjoint functor Ind^ : Mod-B —» Mod- A given by 

Ind^(M) = M ®b eA. 

Then Res^ is exact and Indj^ is left exact. 

Theorem 5.1 (Green). Let e ^ 0 be an idempotent of an associative algebra 
A. 

(1) If M £ Mod-A is simple, then Res^ e (M) £ Mod-eAe is either trivial 
or simple. 

(2) If N £ Mod-eAe is simple, then the quotient of lndf Ae (N) by its unique 
maximal submodule 

jm £ Ind ^ Ae (N) \ mAe = o| 

is the unique simple M £ Mod-A such that Res f Ae (M) = N. 
Consequently, there is a one-to-one correspondence between simple A-modules 
that are not annihilated by e and simple B-modules. 

Around the same time, Munn [14] & Ponizovskii [15] independently furthered 
the work of Clifford [1] by characterizing irreducible representations of a finite 
semigroup by those of its principal factors. Lallement & Petrich [11], and later 
Rhodes & Zalcstein [19], provided a precise construction based on Theorem 3.5. 
We closely follow the arguments of Ganyushkin, Mazorchuk & Steinberg [5] in 
which the same results are recovered by virtue of Theorem 5.1. 

Let 5 be a finite semigroup. For a field K, I\S is artinian, so that the 
notions of semisimplicity and semiprimitivity coincide. It is evident that I\S 
need not be semisimple. Consider, for instance, KX for any finite set A'. For 
M £ Mod- ATS', we denote by Anns(M) the ideal of S consisting of elements 
that annihilate M. 

Definition 5.2. Let M £ Mod-A'S, where AT is a field and S a finite semigroup. 
If e is an idempotent of S satisfying 

Ann s{M) = {s £ S \ J e C J{s)}, 

then J e is said to be the apex of M. 

Suppose M £ Mod-ATS is simple. Then there exists a unique apex J e of M. 
Set I = Ann s(M). We identify M with the unique simple N £ Mod-A'S/AT/ 
such that TVe / 0. By Proposition 3.2, 

e(KS/KI)e = AT(eSe)/AT(e7e) = KH e . 
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Let E(S) be a collection of idempotent class representatives of regular j-classes of 
S. We also write Res^■ (M) and Ind# e (M), respectively, to mean the restriction 
and induction functors. 

Theorem 5.3 (Munn-Ponizovskii). Let K be a field. Suppose e g E(S), where 
S is a finite semigroup. 

(1) //Mg Mod-A - S is simple with apex J e , then Resf^(M) G Mod -KH e is 
simple. 

(2) If N G Mod -KH e is simple, then the quotient o/Indfj (iV) by its unique 
maximal submodule 

|to G Ind^ e (N) | mI\Se = oj 

is the unique simple M G Mod-A'S 1 with apex J e such that Resfj (M) = 

N. 

Consequently, there is a one-to-one correspondence between irreducible represen¬ 
tations of S and those of H e for e G E(S). 

Again, by Proposition 3.2, we know e(KS/KI) = R e , from which it follows 
that 

= N ®KH e KR e 

for any N G Mod-A'7/ e , where e G E(S). 

Scliiitzenberger [20, 21] studied the action of S on L s and R s for any s G S. 
First define A (H s ) to be the quotient of the right action of the monoid 

{u G S' 1 | uH s C H s } 

on H s by its kernel. Then A {H s ) is isomorphic to the group of all maps of the 
form X u \h s : H s —>• H s , and acts freely on R s from the left. We call A (H s ) the 
left Schiitzenberger group of H s . Its orbit space A (H S )\R S consists of fpclasses 
in R s . Moreover, A (H s ) = A(Ht) if s t. A dual statement holds for the right 
Schiitzenberger group T(H S ). In particular, A (H s ) = T(H s ) op . 

Suppose A (H S )\R S consists of n number of b-classes. Choose a class repre¬ 
sentative for each fpclass, so that we can write 


A (H S )\R S = {H S1 ,--- ,H S J. 

Let 1 < i < n. Given t G S, if sfi G R s , then sfi G H Sj for some 1 < / < n, 
and so there exists h G A (H s ) such that sfi = hsj. The right Schiitzenberger 
representation is a map p : S —>• M n (A (H s )) defined by 




h if sfi = hsj, 
0 otherwise. 


The dual construction leads to the left Schiitzenberger representation A : S —>• 
M n (T(H s )). 
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5.2 Holonomy Decomposition 

The original proof of Theorem 4.5 by Krohn & Rhodes [10] is purely algebraic. 
Based on the work of Zeiger [24, 25], Eilenberg [4] devised a decomposition that 
retains the combinatorial structure of a transformation semigroup. 

Let (X, S) be a transformation semigroup. We can extend the action of S 
on X to S 1 by requiring that xl = x for any x G X. Set 

XS={Xs | s G S 1 UX}U{0}. 

Write a < b if a C bs for some s € S 1 . Then the quasiorder < induces an 
equivalence relation ~ given by a ~ b if and only if a < b and b < a. We write 
a < b to mean a < b and not b < a. A height function is a map 77 : XS —>■ Z 
satisfying 
( 1 ) * 7 ( 0 ) = - 1 , 

(2) ij(x) = 0 if x G X, 

(3) a ~ b implies 77 (a) = 77 ( 6 ), 

(4) a < b implies 77 (a) < 77 ( 6 ), 

(5) 77 (a) = 7 for some a G XS if 0 < i < r/(X). 

The height of (X, S), denoted r)(X, S), is defined as t]{X). We can always define 
a height function on XS by assigning 77 (a) = i, where ao < • • • < a^ is a maximal 
chain in XS such that a 0 G X and a^ = a. 

Assume |a| > 1 for a G XS. Consider the set X a of all maximal proper 
subsets of a contained in XS. We call an element of X a a brick of a. If as = a, 
then X a s = X„, so that s permutes X a . Let G a denote the coimage of 

(s G S | as = s} —>■ Sym(X a ). 

Clearly, G a -< S. If G a / 0, (X a ,G a ) is a transformation group. Furthermore, 
a ~ b implies (X Q , G a ) — (X&, Gb )■ In case G a = 0, put G a = 1. 

Suppose 77 admits j elements, say ai, • • ■ , aj, of height k in X5/~. Then we 
call Xfc = X 0l x • ■ • x X ai the fcth paving and Gk = G ai x • • • x G aj the fcth 
holonomy group. The fcth holonomy is the transformation semigroup 

HoU(X, S) = ( X k ,G k ). 

This is well-defined since G k is independent of the choice of ■ ■ ■ ,aj in XS/~. 

Theorem 5.4 (Eilenberg). If (X, S') is a transformation semigroup with a 
height function 77 : XS —y 7L such that r](X : S ) = n, then 

(X, S) -< Holi(X, S) l- ■ • l Hol„(X, S), 

where HoL(X, S) is the ith holonomy for 1 < i < n. 

The decomposition in Theorem 5.4 is known as the holonomy decomposition 
of (X', S) induced by 77 . For brevity, we write 

Hoi* (X, S) = Holi(X, S) C • • l Hol„(X, S). 
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Since n 1 embeds in n direct copies of 2 1 , applying Theorem 4.4 to Theorem 5.4 
indeed leads to a prime decomposition of (X,S). If Hoi* (A', S) = ( Y,T ), then 
T is called the holonomy monoid of (A, S'). 

Definition 5.5. Let (X,S) and (Y,T) be transformation semigroups. If there 
exists a surjective relation p :Y —> X such that for every s G S, 


ps C tip 

for some t G T, then ( Y,T) is said to cover (X, S) by tp. We write 

(X,S) ^ re i (Y, T) 

to mean ( Y,T ) is a cover of (X,S), and refer to ip as a relational covering. 

If Yip C AS, then the rank of p is the smallest integer k > 0 such that 
r](yp) fs ft for all y G Y. Note that (A, S) divides (Y, T) when p is of rank 0. 

Sketch of proof of Theorem 5.j. It suffices to show that if p : Y —» A is of rank 
ft, then there exists a map ip : X k xh-> A of rank k — 1 such that 


(A, S) ^ rel Holfc(A, S) 1 (Y, T) 

by tp, for l 1 covers (A', S) by the unique relation 1 —» A of rank n. 

Let ai, • • • ,aj represent elements of height k in AS/~. If T](yp) = ft, then 
2/7? ~ Oi for a unique 1 < i < j, so that we can find u y ,v y G S such that 


= yp and ypv v = a*. 


Assume such a selection has been made for all y Gb such that r/{yp) = ft. We 
write a projection map as 7q : (A k,Gk) —> (A ai ,G ai ). Define tp : Xk xY —» A 
by 




2/v 3 ^ ^(yv 3 ) < ft. 

foqUy if yp ~ dj. 


It is easy to see that tp is of rank ft — 1 with lm('0) C AS. 

Fix s G S'. It remains to prove that there exists (/, t) G (Gfc U A^) 5 xi T 
such that the diagram 


(/,i) 

A fc x y - > A fc x y 


tp 


tp 


X 


■4 X 
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commutes. Choose any t £ T satisfying ps C tip. We can find a map / : Y —» 
Gk U Xk such that if yip ~ a*, then 


/tt» 


UySVyt if r/<^s = ytip , 

bi if ypsvyt C bi with b t G X 0i . 


It is routine to check that if s C (f,t)ip. □ 

Given t £ T, ti denotes the ith component of t. In particular, if 1 < i < n, 
then ti is a map Xj + i x • • • x X n —>■ Gi U X». Suppose that if either 

( 1 ) there exists (xk+i, • • • , x n ) G Xfc+i x • • • x X n such that (xk+i, • • • , x n )tk £ 
Gk for some 1 < k < n, 

(2) t n £ G n with k = n, 

then {xi+ 1 , • • • , x n )ti £ Gi for all 1 < i < k. Then t is said to satisfy the Zeiger 
property. 


Lemma 5.6. Suppose (X, S) is a transformation semigroup with a height func¬ 
tion rj : XS —> Z such that rj(X, S ) = n, which admits a decomposition 


Hoi* (X, S) = ( Y,T). 


Then the set U of elements ofT satisfying the Zeiger property forms a submonoid 
of T such that ( Y,U) covers (X, 5). 

Proof. It is easy to see that U is indeed a monoid. Assume {xk+ i, • • • ,x n )tk £ 
Gk for 1 < k < n. By construction, 


{Xki ? Xn)pS — ( Xki > 5 

where ip : Xk x • • • x X n —> X is a relation of rank k — 1 such that 
(X, S) ^ re i Hol fc (X, 5) l- ■ -l Hol„ (X, S) 

by ip. If ai, • • • ,aj are elements of height k in XS/~, then (xk+ i, • • • , x n )p ~ a, 
for some 1 < i < j. Define tk-i '■ Xk x • • • x X n —>• Gk -i by 

( Xk, 7 Xn)tk—\r^k = ^{xk+l,-" ,x n )^{xk +1 ,x n ) * 

Put <fc_i 7 Tj = l( 5 a for i ^ k. The case when k = n is similar. □ 

A height function uniquely determines U, which is referred to as the reduced 
holonomy monoid of (X, S'). We also write 

Hd*(X,S) = (Y,U), 

and call (Y, U) the reduced holonomy decomposition of (X, S) induced by 77 . 


18 



5.3 Representation Theory of Reduced Holonomy Monoid 

Suppose a height function r/ : XS —» Z on a transformation semigroup (X,S) 
such that rj(X, S) = n induces the reduced holonomy decomposition 

Hd*(A,S) = (Y,U). 

We wish to study the representation theory of the transition monoid (Y,U, P). 
Since PJ7 does not have an additive structure, we apply Theorem 5.3 to C U, 
and consider the inclusion PU CU. 

The depth function on U is a map 5 : U —> Z such that for u £ U, S(u) = k 
if there exists 0 < k < m satisfying 

(1) Im(tij) fl Gi ^ 0 for 1 < i < k, 

(2) Im(tij) is a singleton in Xi for k < i < n, 

and 5(u) = — 1 otherwise. The depth of ( X , S) is the largest integer —1 <m<n 
such that <5(it) = m for some u € U. We refer to the pair (m, n) as the dimension 
of (A', S), and write dim(A, S) = ( m, n). 

Proposition 5.7. Let (A', S) be a transformation semigroup with height func¬ 
tion rj : XS —> Z, which induces a reduced holonomy decomposition 

Hd*(A,S) = C Y,U) 


such that dim(A, S) = (m, n). Then u £ Uis regular if and only if S(u) = k for 
some 0 < k < m. Therefore e £ U such that 5(e) = k is idempotent in U if and 
only if 

(1) (xi +1 ,---,x n )e i = lG i forl<i<k, 

(2) e* = Xi for k < i < n 

for some (x k +i,- ■ • , x n ) £ X k+1 x ■ • • x X n . 


Proof. If u £ U is regular, there exists v £ U such that uvu = u. Fix 1 < k < n. 
Suppose Im(ttfc_i) C X k -\ and Im(itfc) is a singleton in X k for k < i < n. Then 


and so Im(ztfc_i) is also a singleton in X k ~\. 

Conversely, assume u £ U with 5(u) = k for some 1 < k < m. This means 
(xk+i, ■ , x n )u k £ G fc for some (x k +i, ,x n ) £ X k+1 x • • • x X n . We want 
to find v £ U such that uvu = u. Set vt = Xi for k < i < n. It follows from 
Lemma 5.6 that (cci+i, • • • ,x n )ui £ Gi when 1 < i < k. Therefore there exists 
Vi : A,; + i x • ■ ■ x X n — > Gi such that 

= l Gt 


for 1 < i < k. 


□ 


Given 1 < k < m, denote by H k the group acting on A'i x • • • x X k for the 
transformation group 


(Xi, Gi) 1---1 (X k , Gfc). 
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For fixed y £ Y, define 

E(U, y) = {e £ U \ e 2 = e and e* = iji whenever e* ^ 1 < 3 , for 1 < i < n}. 

Then E(U, y ) contains exactly one idempotent of depth k for each 1 < k < m. 
We also write 

Yi — A. 2 - 1-1 x • • • x X n 

for 0 < i < n, so that Y 0 = Y and Y n = 0. Then iT*, x Yj, is a subsemigroup of 
17 containing e € E(U,y) such that 6(e) = k. 

Proposition 5.8. Let ( X , 5 1 ) 6e a transformation semigroup with height func¬ 
tion y : XS —> Z, which induces a reduced holonomy decomposition 

Hd*(X,S) = (Y,U) 


such that dim(7Y, S ) = (m, n). Fix y & Y. If u,v £ U are regular with 6(u) = k, 
then 

( 1 ) u v if and only if 6(u) = 6(v) and Ui = Vi for every k < i < n, 

(2) u ~j v if and only if 5(u) = 6(v). 

For 1 < k < m, if e € E(U, y ) such that 6(e) = k, then 

(3) R e “ H k x 

(4) H e ^H k . 

Proof. (1) If u ~[ v, then it is necessary that 6(u) = 6(v), and hence Ui = ty for 
k < i < n. Assume the converse. By Lemma 5.6 and Proposition 5.7, there is 

(x k +i, ■ ■ ■ , x n ) £ X k+ i x • • • x X n such that (xj+i, • • • , x n )ui £ Gi for 1 < i < k. 

Therefore we can find w £ U such that 

(Wj -Li ,••• ,W„ ) 

wp * +1> ’ Ui = Vi 

for 1 < i < k once we set Wi = Xi for k < i < n. This shows that wu = v. By 
symmetry, we conclude that u v. 

(2) Again, u ~j v implies that 6(u) = 6(v). Conversely, if 6(u) = 6(v), then 
u ue if e £ U such that 5(e) = k is an idempotent defined by 


ei = 



for 1 < i < k, 
otherwise. 


It follows from (1) that ue ~i v. 

(3) Assume u ~ r e. By (2), 5(u) = k , which means Ui is a singleton in Xf 
for k < i < n. Since ev = u for some v £ U, 


for 1 < * < fc, which shows that Ui does not depend on X k +\ x • ■ -xX n . Similarly, 
uw = e for some w £ U, and hence 

U .(u i+ _ e . 

Whenever 1 < i < k, Im(ui) C Gi since ei = lev Therefore we can conclude 
that R e C Hi x Yi- The opposite inclusion is obvious. 

(4) This is an immediate consequence of (1) and (3). □ 
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Proposition 5.8 implies that there are exactly m regular j-classes in U whose 
maximal subgroup is determined by the first k holonomy groups. We can now 
apply this to Theorem 5.3 to determine all irreducible representations of U. 

Theorem 5.9. Let ( X , S) be a transformation semigroup with height function 
r/ : XS —>■ 1, which induces a reduced holonomy decomposition 

KoU(X,S) = (Y,U) 

such that dim(A', S) = (m,n). Fix y G Y. If I\ is a field, then Mi G Mod -KU 
satisfying 

Mi=M ®KHi K(H, x Yi), 

where M G Mod-A'IA is simple and H e = Hi for e G E(U,y) with 6(e) = i 
for 1 < i < m, is principal indecomposable. Furthermore, Mi contains a unique 
maximal submodule 

Ni = {m G Mi | mKUe = 0} , 
so that Mi/Ni G Mod-Ait/ is simple. 

Proof. It is easy to see that elements m® (1 Hi,z), where m is a basis of M and 
z G Yi , form a basis of Mj. For any (h, z) G H t x Yi, we can write 

m ® (h , z) = m(h, yi) ® (1, z). 

This implies that Mi is indecomposable. Since Mj is free, it is projective, and 
hence principal indecomposable. The result follows from Theorem 5.3. □ 

It follows from Theorem 5.3 that modules of the form Mj/Nj induced by a 
simple right A'i^-module M, where H e = Hi for some e G E(U , y), account for 
all simple right A'A-modules. 
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